04/16/21 - 15:39

Dataset statistics

Number of variables	22
Number of observations	284385
Missing cells	2254014
Missing cells (%)	36.0%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	66.2 MiB
Average record size in memory	244.0 B

Variable types

Numeric	12
Unsupported	7
Categorical	3

Warnings

`danger` has constant value "1.0"	Constant
`operation_car` has constant value "18.0"	Constant
`operation_date` has a high cardinality: 36898 distinct values	High cardinality
`operation_car` is highly correlated with `danger`	High correlation
`danger` is highly correlated with `operation_car`	High correlation
`index_train` has 284385 (100.0%) missing values	Missing
`danger` has 259542 (91.3%) missing values	Missing
`loaded` has 284385 (100.0%) missing values	Missing
`operation_train` has 284385 (100.0%) missing values	Missing
`rod_train` has 284385 (100.0%) missing values	Missing
`ssp_station_esr` has 284385 (100.0%) missing values	Missing
`ssp_station_id` has 284385 (100.0%) missing values	Missing
`weight_brutto` has 284385 (100.0%) missing values	Missing
`adm` is highly skewed (γ1 = 45.65797459)	Skewed
`df_index` has unique values	Unique
`index_train` is an unsupported type, check if it needs cleaning or further analysis	Unsupported
`loaded` is an unsupported type, check if it needs cleaning or further analysis	Unsupported
`operation_train` is an unsupported type, check if it needs cleaning or further analysis	Unsupported
`rod_train` is an unsupported type, check if it needs cleaning or further analysis	Unsupported
`ssp_station_esr` is an unsupported type, check if it needs cleaning or further analysis	Unsupported
`ssp_station_id` is an unsupported type, check if it needs cleaning or further analysis	Unsupported
`weight_brutto` is an unsupported type, check if it needs cleaning or further analysis	Unsupported
`receiver` has 2937 (1.0%) zeros	Zeros
`sender` has 40034 (14.1%) zeros	Zeros

Reproduction

Analysis started	2021-04-16 09:39:41.506588
Analysis finished	2021-04-16 09:40:45.875426
Duration	1 minute and 4.37 seconds
Software version	pandas-profiling v2.11.0
Download configuration	config.yaml

df_index
Real number (ℝ_≥0)

UNIQUE

Distinct	284385
Distinct (%)	100.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	2210794.046
Minimum	1
Maximum	4189899
Zeros	0
Zeros (%)	0.0%
Memory size	2.2 MiB

Quantile statistics

Minimum	1
5-th percentile	219129.2
Q1	1175631
median	2282291
Q3	3262090
95-th percentile	3997662.8
Maximum	4189899
Range	4189898
Interquartile range (IQR)	2086459

Descriptive statistics

Standard deviation	1209242.33
Coefficient of variation (CV)	0.5469719499
Kurtosis	-1.206029417
Mean	2210794.046
Median Absolute Deviation (MAD)	1046187
Skewness	-0.1414585436
Sum	6.287166647 × 10¹¹
Variance	1.462267013 × 10¹²
Monotocity	Strictly increasing

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
3147777	1	< 0.1%
859657	1	< 0.1%
3532310	1	< 0.1%
2846736	1	< 0.1%
4060692	1	< 0.1%
1426962	1	< 0.1%
384529	1	< 0.1%
1834647	1	< 0.1%
2977287	1	< 0.1%
3354089	1	< 0.1%
Other values (284375)	284375	> 99.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	1	< 0.1%
14	1	< 0.1%
23	1	< 0.1%
28	1	< 0.1%
40	1	< 0.1%
60	1	< 0.1%
82	1	< 0.1%
97	1	< 0.1%
99	1	< 0.1%
108	1	< 0.1%

Value	Count	Frequency (%)
4189899	1	< 0.1%
4189882	1	< 0.1%
4189858	1	< 0.1%
4189855	1	< 0.1%
4189838	1	< 0.1%
4189814	1	< 0.1%
4189764	1	< 0.1%
4189756	1	< 0.1%
4189745	1	< 0.1%
4189717	1	< 0.1%

index_train
Unsupported

MISSING
REJECTED
UNSUPPORTED

Missing	284385
Missing (%)	100.0%
Memory size	2.2 MiB

length
Real number (ℝ_≥0)

Distinct	71
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	1.023860049
Minimum	0.78
Maximum	2.13
Zeros	0
Zeros (%)	0.0%
Memory size	2.2 MiB

Quantile statistics

Minimum	0.78
5-th percentile	0.85
Q1	1
median	1
Q3	1
95-th percentile	1.36
Maximum	2.13
Range	1.35
Interquartile range (IQR)	0

Descriptive statistics

Standard deviation	0.1670497071
Coefficient of variation (CV)	0.1631567784
Kurtosis	12.97238546
Mean	1.023860049
Median Absolute Deviation (MAD)	0
Skewness	3.299744712
Sum	291170.44
Variance	0.02790560464
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1	172511	60.7%
1.06	41746	14.7%
0.87	27989	9.8%
0.83	10560	3.7%
0.85	3905	1.4%
1.82	2938	1.0%
1.36	2771	1.0%
1.22	2683	0.9%
1.41	2406	0.8%
1.85	2075	0.7%
Other values (61)	14801	5.2%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0.78	6	< 0.1%
0.79	1940	0.7%
0.81	2	< 0.1%
0.82	9	< 0.1%
0.83	10560	3.7%
0.85	3905	1.4%
0.86	1149	0.4%
0.87	27989	9.8%
0.88	6	< 0.1%
0.9	181	0.1%

Value	Count	Frequency (%)
2.13	18	< 0.1%
1.93	4	< 0.1%
1.92	188	0.1%
1.89	222	0.1%
1.85	2075	0.7%
1.84	32	< 0.1%
1.83	1025	0.4%
1.82	2938	1.0%
1.78	18	< 0.1%
1.77	483	0.2%

car_number
Real number (ℝ_≥0)

Distinct	198464
Distinct (%)	69.8%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	58382707.98
Minimum	21094370
Maximum	98099997
Zeros	0
Zeros (%)	0.0%
Memory size	2.2 MiB

Quantile statistics

Minimum	21094370
5-th percentile	30869847.4
Q1	52871183
median	57919664
Q3	63016737
95-th percentile	92662030
Maximum	98099997
Range	77005627
Interquartile range (IQR)	10145554

Descriptive statistics

Standard deviation	13957131.37
Coefficient of variation (CV)	0.2390627611
Kurtosis	1.593582805
Mean	58382707.98
Median Absolute Deviation (MAD)	5072216
Skewness	0.6581232365
Sum	1.660316641 × 10¹³
Variance	1.948015161 × 10¹⁴
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
44606663	35	< 0.1%
92630409	31	< 0.1%
44335016	31	< 0.1%
37847035	30	< 0.1%
24482465	30	< 0.1%
37846995	30	< 0.1%
44439271	28	< 0.1%
44409365	25	< 0.1%
37812344	25	< 0.1%
37688470	25	< 0.1%
Other values (198454)	284095	99.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
21094370	1	< 0.1%
21136163	5	< 0.1%
21136429	3	< 0.1%
21136445	1	< 0.1%
21138474	1	< 0.1%
21139175	1	< 0.1%
21226634	1	< 0.1%
21232863	1	< 0.1%
21279708	1	< 0.1%
21776760	2	< 0.1%

Value	Count	Frequency (%)
98099997	1	< 0.1%
98099989	1	< 0.1%
98099971	1	< 0.1%
98099963	1	< 0.1%
98099955	1	< 0.1%
98099948	1	< 0.1%
98099930	1	< 0.1%
98099922	1	< 0.1%
98099914	1	< 0.1%
98099906	1	< 0.1%

destination_esr
Real number (ℝ_≥0)

Distinct	1087
Distinct (%)	0.4%
Missing	1025
Missing (%)	0.4%
Infinite	0
Infinite (%)	0.0%

Mean	886024.297
Minimum	13000
Maximum	998100
Zeros	0
Zeros (%)	0.0%
Memory size	2.2 MiB

Quantile statistics

Minimum	13000
5-th percentile	831504
Q1	863007
median	887904
Q3	932207
95-th percentile	980802
Maximum	998100
Range	985100
Interquartile range (IQR)	69200

Descriptive statistics

Standard deviation	103294.375
Coefficient of variation (CV)	0.1165818763
Kurtosis	40.86339312
Mean	886024.297
Median Absolute Deviation (MAD)	26498
Skewness	-5.741912293
Sum	2.510638448 × 10¹¹
Variance	1.066972791 × 10¹⁰
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
862108	15546	5.5%
864902	13940	4.9%
861406	13491	4.7%
864809	8940	3.1%
911605	8387	2.9%
863007	8112	2.9%
946801	7998	2.8%
862201	7491	2.6%
893106	4987	1.8%
887603	4848	1.7%
Other values (1077)	189620	66.7%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
13000	1	< 0.1%
14906	1	< 0.1%
15701	1	< 0.1%
16009	5	< 0.1%
18502	398	0.1%
20706	2	< 0.1%
21401	7	< 0.1%
27802	4	< 0.1%
30006	2	< 0.1%
31808	2	< 0.1%

Value	Count	Frequency (%)
998100	8	< 0.1%
997502	19	< 0.1%
997108	1	< 0.1%
996904	151	0.1%
996800	1	< 0.1%
996603	24	< 0.1%
996302	28	< 0.1%
995808	1	< 0.1%
995507	118	< 0.1%
995403	67	< 0.1%

adm
Real number (ℝ_≥0)

SKEWED

Distinct	11
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	20.06934262
Minimum	20
Maximum	99
Zeros	0
Zeros (%)	0.0%
Memory size	2.2 MiB

Quantile statistics

Minimum	20
5-th percentile	20
Q1	20
median	20
Q3	20
95-th percentile	20
Maximum	99
Range	79
Interquartile range (IQR)	0

Descriptive statistics

Standard deviation	0.8738641046
Coefficient of variation (CV)	0.04354223859
Kurtosis	3783.390195
Mean	20.06934262
Median Absolute Deviation (MAD)	0
Skewness	45.65797459
Sum	5707420
Variance	0.7636384733
Monotocity	Not monotonic

Histogram with fixed size bins (bins=11)

Value	Count	Frequency (%)
20	281254	98.9%
26	1881	0.7%
27	920	0.3%
21	253	0.1%
25	24	< 0.1%
33	20	< 0.1%
99	16	< 0.1%
24	8	< 0.1%
22	6	< 0.1%
28	2	< 0.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
20	281254	98.9%
21	253	0.1%
22	6	< 0.1%
24	8	< 0.1%
25	24	< 0.1%
26	1881	0.7%
27	920	0.3%
28	2	< 0.1%
33	20	< 0.1%
57	1	< 0.1%

Value	Count	Frequency (%)
99	16	< 0.1%
57	1	< 0.1%
33	20	< 0.1%
28	2	< 0.1%
27	920	0.3%
26	1881	0.7%
25	24	< 0.1%
24	8	< 0.1%
22	6	< 0.1%
21	253	0.1%

danger
Categorical

CONSTANT
HIGH CORRELATION
MISSING
REJECTED

Distinct	1
Distinct (%)	< 0.1%
Missing	259542
Missing (%)	91.3%
Memory size	11.3 MiB

1.0	24843

Length

Max length	3
Median length	3
Mean length	3
Min length	3

Characters and Unicode

Total characters	74529
Distinct characters	3
Distinct categories	2 ?
Distinct scripts	1 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	1.0
2nd row	1.0
3rd row	1.0
4th row	1.0
5th row	1.0

Value	Count	Frequency (%)
1.0	24843	8.7%
(Missing)	259542	91.3%

Histogram of lengths of the category

Value	Count	Frequency (%)
1.0	24843	100.0%

Most occurring characters

Value	Count	Frequency (%)
1	24843	33.3%
.	24843	33.3%
0	24843	33.3%

Most occurring categories

Value	Count	Frequency (%)
Decimal Number	49686	66.7%
Other Punctuation	24843	33.3%

Most frequent character per category

Value	Count	Frequency (%)
1	24843	50.0%
0	24843	50.0%

Value	Count	Frequency (%)
.	24843	100.0%

Most occurring scripts

Value	Count	Frequency (%)
Common	74529	100.0%

Most frequent character per script

Value	Count	Frequency (%)
1	24843	33.3%
.	24843	33.3%
0	24843	33.3%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	74529	100.0%

Most frequent character per block

Value	Count	Frequency (%)
1	24843	33.3%
.	24843	33.3%
0	24843	33.3%

gruz
Real number (ℝ_≥0)

Distinct	217
Distinct (%)	0.1%
Missing	894
Missing (%)	0.3%
Infinite	0
Infinite (%)	0.0%

Mean	392403.7683
Minimum	3009
Maximum	731062
Zeros	0
Zeros (%)	0.0%
Memory size	2.2 MiB

Quantile statistics

Minimum	3009
5-th percentile	161128
Q1	421034
median	421034
Q3	421034
95-th percentile	421195
Maximum	731062
Range	728053
Interquartile range (IQR)	0

Descriptive statistics

Standard deviation	76212.44065
Coefficient of variation (CV)	0.1942194413
Kurtosis	4.512670237
Mean	392403.7683
Median Absolute Deviation (MAD)	0
Skewness	-2.405033588
Sum	1.112429367 × 10¹¹
Variance	5808336110
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
421034	220656	77.6%
421195	17753	6.2%
161128	6358	2.2%
236038	5714	2.0%
161043	4129	1.5%
321067	3702	1.3%
321029	2965	1.0%
161185	2555	0.9%
421208	2232	0.8%
421087	2164	0.8%
Other values (207)	15263	5.4%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
3009	30	< 0.1%
11005	55	< 0.1%
14003	4	< 0.1%
18023	17	< 0.1%
18112	1	< 0.1%
21083	16	< 0.1%
41119	1	< 0.1%
81046	5	< 0.1%
81135	3	< 0.1%
81145	1	< 0.1%

Value	Count	Frequency (%)
731062	1	< 0.1%
725502	10	< 0.1%
721484	7	< 0.1%
711459	1	< 0.1%
711035	2	< 0.1%
693227	47	< 0.1%
693176	2	< 0.1%
693161	49	< 0.1%
693157	1	< 0.1%
693087	23	< 0.1%

loaded
Unsupported

MISSING
REJECTED
UNSUPPORTED

Missing	284385
Missing (%)	100.0%
Memory size	2.2 MiB

operation_car
Categorical

CONSTANT
HIGH CORRELATION
REJECTED

Distinct	1
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	16.5 MiB

18.0	284385

Length

Max length	4
Median length	4
Mean length	4
Min length	4

Characters and Unicode

Total characters	1137540
Distinct characters	4
Distinct categories	2 ?
Distinct scripts	1 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	18.0
2nd row	18.0
3rd row	18.0
4th row	18.0
5th row	18.0

Value	Count	Frequency (%)
18.0	284385	100.0%

Histogram of lengths of the category

Value	Count	Frequency (%)
18.0	284385	100.0%

Most occurring characters

Value	Count	Frequency (%)
1	284385	25.0%
8	284385	25.0%
.	284385	25.0%
0	284385	25.0%

Most occurring categories

Value	Count	Frequency (%)
Decimal Number	853155	75.0%
Other Punctuation	284385	25.0%

Most frequent character per category

Value	Count	Frequency (%)
1	284385	33.3%
8	284385	33.3%
0	284385	33.3%

Value	Count	Frequency (%)
.	284385	100.0%

Most occurring scripts

Value	Count	Frequency (%)
Common	1137540	100.0%

Most frequent character per script

Value	Count	Frequency (%)
1	284385	25.0%
8	284385	25.0%
.	284385	25.0%
0	284385	25.0%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	1137540	100.0%

Most frequent character per block

Value	Count	Frequency (%)
1	284385	25.0%
8	284385	25.0%
.	284385	25.0%
0	284385	25.0%

operation_date
Categorical

HIGH CARDINALITY

Distinct	36898
Distinct (%)	13.0%
Missing	0
Missing (%)	0.0%
Memory size	20.6 MiB

2020-07-22 13:29:00	133
2020-07-25 07:33:00	130
2020-07-22 08:35:00	122
2020-07-30 13:50:00	122
2020-07-20 12:04:00	121
Other values (36893)	283757

Length

Max length	19
Median length	19
Mean length	19
Min length	19

Characters and Unicode

Total characters	5403315
Distinct characters	13
Distinct categories	4 ?
Distinct scripts	1 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	4080 ?
Unique (%)	1.4%

Sample

1st row	2020-07-16 14:10:00
2nd row	2020-07-16 08:38:00
3rd row	2020-07-16 05:23:00
4th row	2020-07-16 08:59:00
5th row	2020-07-15 21:52:00

Value	Count	Frequency (%)
2020-07-22 13:29:00	133	< 0.1%
2020-07-25 07:33:00	130	< 0.1%
2020-07-22 08:35:00	122	< 0.1%
2020-07-30 13:50:00	122	< 0.1%
2020-07-20 12:04:00	121	< 0.1%
2020-07-17 23:40:00	118	< 0.1%
2020-07-23 04:51:00	118	< 0.1%
2020-07-22 08:29:00	115	< 0.1%
2020-07-22 08:34:00	114	< 0.1%
2020-07-30 17:32:00	114	< 0.1%
Other values (36888)	283178	99.6%

Histogram of lengths of the category

Value	Count	Frequency (%)
2020-07-17	15082	2.7%
2020-07-22	14977	2.6%
2020-07-26	14457	2.5%
2020-07-28	14116	2.5%
2020-07-29	13868	2.4%
2020-07-16	13789	2.4%
2020-07-18	13707	2.4%
2020-07-19	13481	2.4%
2020-07-27	13370	2.4%
2020-07-25	13076	2.3%
Other values (1461)	428847	75.4%

Most occurring characters

Value	Count	Frequency (%)
0	1733004	32.1%
2	857687	15.9%
-	568770	10.5%
:	568770	10.5%
7	372421	6.9%
1	355420	6.6%
	284385	5.3%
3	144005	2.7%
5	130970	2.4%
4	123395	2.3%
Other values (3)	264488	4.9%

Most occurring categories

Value	Count	Frequency (%)
Decimal Number	3981390	73.7%
Dash Punctuation	568770	10.5%
Other Punctuation	568770	10.5%
Space Separator	284385	5.3%

Most frequent character per category

Value	Count	Frequency (%)
0	1733004	43.5%
2	857687	21.5%
7	372421	9.4%
1	355420	8.9%
3	144005	3.6%
5	130970	3.3%
4	123395	3.1%
9	88612	2.2%
8	88035	2.2%
6	87841	2.2%

Value	Count	Frequency (%)
-	568770	100.0%

Value	Count	Frequency (%)
	284385	100.0%

Value	Count	Frequency (%)
:	568770	100.0%

Most occurring scripts

Value	Count	Frequency (%)
Common	5403315	100.0%

Most frequent character per script

Value	Count	Frequency (%)
0	1733004	32.1%
2	857687	15.9%
-	568770	10.5%
:	568770	10.5%
7	372421	6.9%
1	355420	6.6%
	284385	5.3%
3	144005	2.7%
5	130970	2.4%
4	123395	2.3%
Other values (3)	264488	4.9%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	5403315	100.0%

Most frequent character per block

Value	Count	Frequency (%)
0	1733004	32.1%
2	857687	15.9%
-	568770	10.5%
:	568770	10.5%
7	372421	6.9%
1	355420	6.6%
	284385	5.3%
3	144005	2.7%
5	130970	2.4%
4	123395	2.3%
Other values (3)	264488	4.9%

operation_st_esr
Real number (ℝ_≥0)

Distinct	636
Distinct (%)	0.2%
Missing	37
Missing (%)	< 0.1%
Infinite	0
Infinite (%)	0.0%

Mean	933430.6451
Minimum	830003
Maximum	998100
Zeros	0
Zeros (%)	0.0%
Memory size	2.2 MiB

Quantile statistics

Minimum	830003
5-th percentile	841604
Q1	888803
median	947005
Q3	984700
95-th percentile	989205
Maximum	998100
Range	168097
Interquartile range (IQR)	95897

Descriptive statistics

Standard deviation	49976.26988
Coefficient of variation (CV)	0.05354042118
Kurtosis	-1.054978203
Mean	933430.6451
Median Absolute Deviation (MAD)	39098
Skewness	-0.5320380603
Sum	2.654191371 × 10¹¹
Variance	2497627551
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
986103	34368	12.1%
947005	21138	7.4%
989309	10977	3.9%
984700	9271	3.3%
987801	7024	2.5%
985702	5985	2.1%
936903	4831	1.7%
980200	4571	1.6%
932207	4455	1.6%
967808	4267	1.5%
Other values (626)	177461	62.4%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
830003	700	0.2%
830107	4	< 0.1%
830200	1281	0.5%
830304	58	< 0.1%
830709	265	0.1%
831203	494	0.2%
831400	361	0.1%
831504	1323	0.5%
831608	77	< 0.1%
831805	128	< 0.1%

Value	Count	Frequency (%)
998100	15	< 0.1%
997502	64	< 0.1%
997108	10	< 0.1%
996904	14	< 0.1%
996800	1	< 0.1%
996603	23	< 0.1%
996302	43	< 0.1%
995808	26	< 0.1%
995507	147	0.1%
995403	2	< 0.1%

operation_st_id
Real number (ℝ_≥0)

Distinct	636
Distinct (%)	0.2%
Missing	37
Missing (%)	< 0.1%
Infinite	0
Infinite (%)	0.0%

Mean	2001030976
Minimum	2000035090
Maximum	2002030163
Zeros	0
Zeros (%)	0.0%
Memory size	2.2 MiB

Quantile statistics

Minimum	2000035090
5-th percentile	2000035688
Q1	2000037498
median	2001930528
Q3	2002025275
95-th percentile	2002025661
Maximum	2002030163
Range	1995073
Interquartile range (IQR)	1987777

Descriptive statistics

Standard deviation	975870.1466
Coefficient of variation (CV)	0.0004876836783
Kurtosis	-1.994430623
Mean	2001030976
Median Absolute Deviation (MAD)	96081
Skewness	-0.03362778002
Sum	5.689891558 × 10¹⁴
Variance	9.52322543 × 10¹¹
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
2002025661	34368	12.1%
2002025275	21138	7.4%
2000039132	10977	3.9%
2002025651	9271	3.3%
2002025683	7024	2.5%
2002025657	5985	2.1%
2000037498	4831	1.7%
2002025607	4571	1.6%
2000037064	4455	1.6%
2000038604	4267	1.5%
Other values (626)	177461	62.4%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
2000035090	11	< 0.1%
2000035110	235	0.1%
2000035130	304	0.1%
2000035140	149	0.1%
2000035162	516	0.2%
2000035176	3	< 0.1%
2000035182	325	0.1%
2000035194	135	< 0.1%
2000035212	18	< 0.1%
2000035222	7	< 0.1%

Value	Count	Frequency (%)
2002030163	1	< 0.1%
2002030161	27	< 0.1%
2002030159	1475	0.5%
2002030157	11	< 0.1%
2002026609	2645	0.9%
2002026607	1	< 0.1%
2002025683	7024	2.5%
2002025669	263	0.1%
2002025667	120	< 0.1%
2002025665	37	< 0.1%

operation_train
Unsupported

MISSING
REJECTED
UNSUPPORTED

Missing	284385
Missing (%)	100.0%
Memory size	2.2 MiB

receiver
Real number (ℝ_≥0)

ZEROS

Distinct	2104
Distinct (%)	0.7%
Missing	892
Missing (%)	0.3%
Infinite	0
Infinite (%)	0.0%

Mean	41214524.29
Minimum	0
Maximum	99964849
Zeros	2937
Zeros (%)	1.0%
Memory size	2.2 MiB

Quantile statistics

Minimum	0
5-th percentile	161878
Q1	10891709
median	26648903
Q3	77096306
95-th percentile	93294342
Maximum	99964849
Range	99964849
Interquartile range (IQR)	66204597

Descriptive statistics

Standard deviation	33669967.5
Coefficient of variation (CV)	0.8169442224
Kurtosis	-1.436794945
Mean	41214524.29
Median Absolute Deviation (MAD)	25589939
Skewness	0.2902644559
Sum	1.168402913 × 10¹³
Variance	1.133666711 × 10¹⁵
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
80298858	13704	4.8%
20439962	13333	4.7%
26635687	12315	4.3%
93149858	11640	4.1%
48134187	10356	3.6%
10891709	8902	3.1%
161878	8378	2.9%
26644096	7316	2.6%
14999355	5982	2.1%
94421386	5713	2.0%
Other values (2094)	185854	65.4%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	2937	1.0%
18595	4	< 0.1%
44474	812	0.3%
59625	10	< 0.1%
64537	53	< 0.1%
83262	3790	1.3%
105147	29	< 0.1%
105213	3	< 0.1%
105457	4	< 0.1%
106158	22	< 0.1%

Value	Count	Frequency (%)
99964849	2	< 0.1%
99863723	8	< 0.1%
99849255	56	< 0.1%
99435157	9	< 0.1%
99417515	1	< 0.1%
99415491	306	0.1%
99339028	1	< 0.1%
99029960	2	< 0.1%
98947553	19	< 0.1%
98933686	1	< 0.1%

rodvag
Real number (ℝ_≥0)

Distinct	11
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	63.14930816
Minimum	20
Maximum	99
Zeros	0
Zeros (%)	0.0%
Memory size	2.2 MiB

Quantile statistics

Minimum	20
5-th percentile	40
Q1	60
median	60
Q3	70
95-th percentile	92
Maximum	99
Range	79
Interquartile range (IQR)	10

Descriptive statistics

Standard deviation	16.21934155
Coefficient of variation (CV)	0.2568411599
Kurtosis	0.7669385446
Mean	63.14930816
Median Absolute Deviation (MAD)	0
Skewness	0.05993310741
Sum	17958716
Variance	263.0670404
Monotocity	Not monotonic

Histogram with fixed size bins (bins=11)

Value	Count	Frequency (%)
60	172235	60.6%
90	31606	11.1%
40	27083	9.5%
70	27060	9.5%
96	10589	3.7%
20	9356	3.3%
92	2468	0.9%
93	1850	0.7%
95	1715	0.6%
87	418	0.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
20	9356	3.3%
40	27083	9.5%
60	172235	60.6%
70	27060	9.5%
87	418	0.1%
90	31606	11.1%
92	2468	0.9%
93	1850	0.7%
95	1715	0.6%
96	10589	3.7%

Value	Count	Frequency (%)
99	5	< 0.1%
96	10589	3.7%
95	1715	0.6%
93	1850	0.7%
92	2468	0.9%
90	31606	11.1%
87	418	0.1%
70	27060	9.5%
60	172235	60.6%
40	27083	9.5%

rod_train
Unsupported

MISSING
REJECTED
UNSUPPORTED

Missing	284385
Missing (%)	100.0%
Memory size	2.2 MiB

sender
Real number (ℝ_≥0)

ZEROS

Distinct	706
Distinct (%)	0.2%
Missing	892
Missing (%)	0.3%
Infinite	0
Infinite (%)	0.0%

Mean	44587853.56
Minimum	0
Maximum	99976605
Zeros	40034
Zeros (%)	14.1%
Memory size	2.2 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	4733886
median	52682351
Q3	69546824
95-th percentile	93315475
Maximum	99976605
Range	99976605
Interquartile range (IQR)	64812938

Descriptive statistics

Standard deviation	34019457.29
Coefficient of variation (CV)	0.7629758908
Kurtosis	-1.439870612
Mean	44587853.56
Median Absolute Deviation (MAD)	34534395
Skewness	-0.07445773709
Sum	1.264034437 × 10¹³
Variance	1.157323474 × 10¹⁵
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	40034	14.1%
52682351	23725	8.3%
68398528	22503	7.9%
93315475	18358	6.5%
69546824	17767	6.2%
56738657	16696	5.9%
83262	10171	3.6%
28384864	8572	3.0%
15199450	8128	2.9%
93294342	7825	2.8%
Other values (696)	109714	38.6%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	40034	14.1%
64537	30	< 0.1%
83262	10171	3.6%
118977	1074	0.4%
148725	3	< 0.1%
153790	18	< 0.1%
160206	65	< 0.1%
161878	1	< 0.1%
186476	138	< 0.1%
186720	2343	0.8%

Value	Count	Frequency (%)
99976605	1	< 0.1%
99863723	2	< 0.1%
99849255	11	< 0.1%
99769585	4	< 0.1%
99415491	146	0.1%
99029960	22	< 0.1%
98951282	1	< 0.1%
98943992	1	< 0.1%
98404545	5	< 0.1%
98114965	1	< 0.1%

ssp_station_esr
Unsupported

MISSING
REJECTED
UNSUPPORTED

Missing	284385
Missing (%)	100.0%
Memory size	2.2 MiB

ssp_station_id
Unsupported

MISSING
REJECTED
UNSUPPORTED

Missing	284385
Missing (%)	100.0%
Memory size	2.2 MiB

tare_weight
Real number (ℝ_≥0)

Distinct	306
Distinct (%)	0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	242.4687202
Minimum	0
Maximum	890
Zeros	1
Zeros (%)	< 0.1%
Memory size	2.2 MiB

Quantile statistics

Minimum	0
5-th percentile	210
Q1	233
median	240
Q3	247
95-th percentile	270
Maximum	890
Range	890
Interquartile range (IQR)	14

Descriptive statistics

Standard deviation	33.00265689
Coefficient of variation (CV)	0.1361109872
Kurtosis	50.0745029
Mean	242.4687202
Median Absolute Deviation (MAD)	7
Skewness	5.682295411
Sum	68954467
Variance	1089.175361
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
245	28572	10.0%
240	28136	9.9%
235	11316	4.0%
237	9473	3.3%
247	9074	3.2%
238	8918	3.1%
184	8214	2.9%
236	8173	2.9%
233	8160	2.9%
243	8148	2.9%
Other values (296)	156201	54.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	1	< 0.1%
172	1	< 0.1%
173	1	< 0.1%
178	1	< 0.1%
179	21	< 0.1%
180	14	< 0.1%
181	19	< 0.1%
182	5	< 0.1%
183	5	< 0.1%
184	8214	2.9%

Value	Count	Frequency (%)
890	4	< 0.1%
880	1	< 0.1%
690	44	< 0.1%
677	3	< 0.1%
663	5	< 0.1%
659	7	< 0.1%
641	13	< 0.1%
640	7	< 0.1%
639	3	< 0.1%
629	6	< 0.1%

weight_brutto
Unsupported

MISSING
REJECTED
UNSUPPORTED

Missing	284385
Missing (%)	100.0%
Memory size	2.2 MiB

Pearson's r

The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.

To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.

Spearman's ρ

The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.

To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.

Kendall's τ

Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.

To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.

Phik (φk)

Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.

Cramér's V (φc)

Cramér's V is an association measure for nominal random variables. The coefficient ranges from 0 to 1, with 0 indicating independence and 1 indicating perfect association. The empirical estimators used for Cramér's V have been proved to be biased, even for large samples. We use a bias-corrected measure that has been proposed by Bergsma in 2013 that can be found here.

A simple visualization of nullity by column.

Nullity matrix is a data-dense display which lets you quickly visually pick out patterns in data completion.

The correlation heatmap measures nullity correlation: how strongly the presence or absence of one variable affects the presence of another.

The dendrogram allows you to more fully correlate variable completion, revealing trends deeper than the pairwise ones visible in the correlation heatmap.

First rows

	df_index	index_train	length	car_number	destination_esr	adm	danger	gruz	loaded	operation_car	operation_date	operation_st_esr	operation_st_id	operation_train	receiver	rodvag	rod_train	sender	ssp_station_esr	ssp_station_id	tare_weight	weight_brutto
0	1	NaN	1.0	62827035	862201.0	20.0	NaN	421034.0	NaN	18.0	2020-07-16 14:10:00	984700.0	2.002026e+09	NaN	93149858.0	60.0	NaN	68398528.0	NaN	NaN	249.0	NaN
1	14	NaN	1.0	62845375	913206.0	20.0	NaN	421034.0	NaN	18.0	2020-07-16 08:38:00	967704.0	2.002026e+09	NaN	13141274.0	60.0	NaN	69546824.0	NaN	NaN	245.0	NaN
2	23	NaN	1.0	62845052	911605.0	20.0	NaN	421034.0	NaN	18.0	2020-07-16 05:23:00	979504.0	2.002027e+09	NaN	161878.0	60.0	NaN	68398528.0	NaN	NaN	241.0	NaN
3	28	NaN	1.0	62846324	967808.0	20.0	NaN	421034.0	NaN	18.0	2020-07-16 08:59:00	967600.0	2.000039e+09	NaN	1126163.0	60.0	NaN	69546824.0	NaN	NaN	245.0	NaN
4	40	NaN	1.0	62843214	967808.0	20.0	NaN	421034.0	NaN	18.0	2020-07-15 21:52:00	967600.0	2.000039e+09	NaN	1126163.0	60.0	NaN	69546824.0	NaN	NaN	245.0	NaN
5	60	NaN	1.0	62844071	861406.0	20.0	NaN	421034.0	NaN	18.0	2020-07-16 06:45:00	986103.0	2.002026e+09	NaN	20439962.0	60.0	NaN	69546824.0	NaN	NaN	245.0	NaN
6	82	NaN	1.0	62840061	861406.0	20.0	NaN	421034.0	NaN	18.0	2020-07-15 22:59:00	986103.0	2.002026e+09	NaN	20439962.0	60.0	NaN	69546824.0	NaN	NaN	245.0	NaN
7	97	NaN	1.0	62841671	987801.0	20.0	NaN	161062.0	NaN	18.0	2020-07-15 21:03:00	988306.0	2.000039e+09	NaN	1126648.0	60.0	NaN	0.0	NaN	NaN	220.0	NaN
8	99	NaN	1.0	62839121	861406.0	20.0	NaN	421034.0	NaN	18.0	2020-07-16 16:42:00	980200.0	2.002026e+09	NaN	20439962.0	60.0	NaN	69546824.0	NaN	NaN	245.0	NaN
9	108	NaN	1.0	62838933	852708.0	20.0	NaN	421034.0	NaN	18.0	2020-07-15 22:26:00	864902.0	2.000040e+09	NaN	55472826.0	60.0	NaN	56738657.0	NaN	NaN	247.0	NaN

Last rows

	df_index	index_train	length	car_number	destination_esr	adm	danger	gruz	loaded	operation_car	operation_date	operation_st_esr	operation_st_id	operation_train	receiver	rodvag	rod_train	sender	ssp_station_esr	ssp_station_id	tare_weight	weight_brutto
284375	4189717	NaN	1.0	62823760	862201.0	20.0	NaN	421034.0	NaN	18.0	2020-07-16 14:52:00	967808.0	2.000039e+09	NaN	93149858.0	60.0	NaN	68398528.0	NaN	NaN	250.0	NaN
284376	4189745	NaN	1.0	62823232	862201.0	20.0	NaN	421034.0	NaN	18.0	2020-07-16 04:23:00	987801.0	2.002026e+09	NaN	93149858.0	60.0	NaN	68398528.0	NaN	NaN	244.0	NaN
284377	4189756	NaN	1.0	62823109	862201.0	20.0	NaN	421034.0	NaN	18.0	2020-07-16 10:59:00	986103.0	2.002026e+09	NaN	93149858.0	60.0	NaN	68398528.0	NaN	NaN	245.0	NaN
284378	4189764	NaN	1.0	62821848	873308.0	20.0	NaN	421195.0	NaN	18.0	2020-07-16 16:50:00	871802.0	2.001934e+09	NaN	94174901.0	60.0	NaN	68398528.0	NaN	NaN	248.0	NaN
284379	4189814	NaN	1.0	62820477	862201.0	20.0	NaN	421034.0	NaN	18.0	2020-07-16 10:59:00	986103.0	2.002026e+09	NaN	93149858.0	60.0	NaN	68398528.0	NaN	NaN	246.0	NaN
284380	4189838	NaN	1.0	62817416	862201.0	20.0	NaN	421034.0	NaN	18.0	2020-07-16 14:54:00	967808.0	2.000039e+09	NaN	93149858.0	60.0	NaN	68398528.0	NaN	NaN	249.0	NaN
284381	4189855	NaN	1.0	62815881	862201.0	20.0	NaN	421034.0	NaN	18.0	2020-07-16 09:46:00	980200.0	2.002026e+09	NaN	93149858.0	60.0	NaN	68398528.0	NaN	NaN	245.0	NaN
284382	4189858	NaN	1.0	62817861	862201.0	20.0	NaN	421034.0	NaN	18.0	2020-07-16 08:15:00	967808.0	2.000039e+09	NaN	93149858.0	60.0	NaN	68398528.0	NaN	NaN	250.0	NaN
284383	4189882	NaN	1.0	62816723	862201.0	20.0	NaN	421034.0	NaN	18.0	2020-07-16 13:56:00	924501.0	2.000037e+09	NaN	93149858.0	60.0	NaN	68398528.0	NaN	NaN	244.0	NaN
284384	4189899	NaN	1.0	62814017	862201.0	20.0	NaN	421034.0	NaN	18.0	2020-07-16 04:04:00	986103.0	2.002026e+09	NaN	93149858.0	60.0	NaN	68398528.0	NaN	NaN	245.0	NaN

Overview

Variables

Most occurring characters

Most occurring categories

Most frequent character per category

Most occurring scripts

Most frequent character per script

Most occurring blocks

Most frequent character per block

Most occurring characters

Most occurring categories

Most frequent character per category

Most occurring scripts

Most frequent character per script

Most occurring blocks

Most frequent character per block

Most occurring characters

Most occurring categories

Most frequent character per category

Most occurring scripts

Most frequent character per script

Most occurring blocks

Most frequent character per block

Interactions

Correlations

Pearson's r

Spearman's ρ

Kendall's τ

Phik (φk)

Cramér's V (φc)

Missing values

Sample

First rows

Last rows